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Abstract 

This paper solves exit problems for spectrally negative Markov additive processes and their 
reflections. A so-called scale matrix, which is a generalization of the scale function of a spectrally 
negative Levy process, plays a central role in the study of exit problems. Existence of the scale 
matrix was shown in |30[ Thm. 3]. We provide a probabilistic construction of the scale matrix, 
and identify the transform. In addition, we generalize to the MAP setting the relation between the 
scale function and the excursion (height) measure. The main technique is based on the occupation 
density formula and even in the context of fluctuations of spectrally negative Levy processes this 
idea seems to be new. Our representation of the scale matrix W{x) = e^^^L{x) in terms of nice 
probabilistic objects opens up possibilities for further investigation of its properties. 

1 Introduction 

This paper solves exit problems for spectrally negative Markov Additive Processes (MAPs) and 
their reflections. Before entering our discussion on this subject we shall simply begin by defining 
the class of processes we intend to work with. Let {ft, T,F,P) be a filtered probability space, with 
standard (right-continuous and augmented) filtration F = {J-t : t > 0}. On this probability space 
consider a real-valued cadlag (right-continuous with left limits) process X — {X{t) : t > 0} and a 
right-continuous jump process J — {J{t) t > 0} with a finite state space E — {1,. . . ,N}, such 
that {X, J) is adapted to the filtration F. The process {X, J) is a MAP if, given {J{t) — i}, the pair 
{X{t + s) ~ X{t), J{t + s)) is independent of J^t and has the same law as {X{s) — X{0), J(s)) given 
{J(0) — i} for all s,t > and i ^ E. It is common to say that X is an additive component and 
J is a background process representing the environment. Importantly, a MAP has a very special 
structure, which we reveal in the following. It is immediate that J is a Markov chain. Furthermore, 
X evolves as some spectrally negative Levy process Xi while J = i. In addition, a transition of 
J from i to j ^ i triggers a jump of X distributed as Uij < 0, where i,j G E. All the above 
components are independent. This structure explains the other commonly used name for a MAP - 
'Markov-modulated Levy process'. 

The use of MAPs is widespread, making it a classical model in applied probability with a variety 
of application areas, such as queues, insurance risk, inventories, data communication, finance, 
environmental problems and so forth, see |1 Ch. XI] , [Ml Ch. 7] , [111 [11 [HI [H [HI SH [H] . 

Throughout this paper we will consider only spectrally negative MAPs, where the additive 
component X has no positive jumps. We exclude the trivial cases when the paths of X are a.s. 
monotone. It is noted that phase- type distributions fit naturally into the framework of MAPs. 
Positive phase- type jumps can be incorporated into the model using a standard trick, see e.g. [5]. 
This is achieved by enlarging the number of states of the background process and replacing phase- 
type jumps by linear stretches of unit slope. 
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One of the main contribution of this paper is in identification, in Theorem [1] of the scale 
matrix W which plays the same role as the scale function in the theory of fiuctuations of Levy 
processes (for a beautiful review on this subject see [T]). Formally, the scale matrix is characterized 
by its Laplace transform: 




e-°"'W{x)dx = F{a)-\ 



where -^(0!) is a matrix analogue of the Laplace exponent of a Levy process: 

E(e"^(*); J(0 = j|J(0) = «) = fe^^")*) • 

V / ij 

This result generalizes |30[ Thm. 3] , where only existence of a scale matrix was proven. In the case 
of spectrally negative Levy process this result follows contributions of [ISl ESI UHl HH SIl HI US] , see 
also [371 H] for an overview. 

In the basis of the above transform lies a probabilistic construction of the scale matrix W{x). It 
is given in dTTI) . and involves the first hitting time of a level —x. It can be seen as a counterpart of 
the representation of the scale function of a Levy process in terms of the potential density at —x, 
see |36l Thm. l(ii)]. It turns out that our representation can be written in a more concise way: 

Wix) = e-^^L{x), 

where A is a transition rate matrix of the Markov chain associated with the first passage, and L{x) 
is a matrix of expected occupation times at up to the first passage time over x. This allows to 
study W{x) by analyzing L{x), which has a very nice probabilistic interpretation. For example, 
we can immediately deduce that the entries of the matrix e^^W{x) are non-negative, increasing 
functions. Considering the domain of Levy processes, it is noted that the function L{x) plays 
an important role in the study of local times, see [SJ Ch. V.3]. Furthermore, |S1 Lem. V.ll] 
determines this function as a doubly indefinite integral, which opens possibilities for new numerical 
identification of the scale function. We give some further comments on these issues in Remark |3. II 

It is well-known in the domain of Levy processes that the intensity of the Poisson process 
(indexed by local time) counting the number of excursions with height exceeding a is given by 
W'j^{a)/W{a), see [SI p- 195]. This result is very important for analyzing the smoothness of the 
scale function, see [42l Lem. 2.3]. We generalize this result to MAPs in Theorem [5] 

Furthermore, we solve exit problems for X, as well as — refiected at their infima. The 
corresponding results are given in Theorem [5] and Theorem |51 They generalize results in [51 1321 155] 
where spectrally one-sided Levy processes were analyzed. The solutions to these exit problems 
contain the second scale matrix Z defined formally in ([3]). 

Finally, we propose new, unified technique for deriving fiuctuation identities for MAPs (and 
Levy process in particular) and their refiections. This technique is based on the properties of 
occupation times jointly with occupation density formula. The main proofs in this paper rely 
on these arguments which, we believe, even in the context of spectrally one-sided Levy processes 
are new. For Levy processes this technique complements the use of martingales (see [3U1 [321 E]), 
potential densities (see [2S]), and excursion calculations (see [151122]). 

The paper is organized as follows. In Section|2]we recall some basic definitions and properties of 
MAPs. In Section [3] we present our main results. In Section 2] we introduce basic facts concerning 
occupation densities for MAPs. In Section |S] we identify the scale matrix proving Theorem [T] 
In Section (5] we focus on some identities for two-sided refiection of a MAP. These identities are 
fundamental in solving exit problems for one-sided reflections, which are analyzed in Section [7] 
Finally, Appendix contains a few technical lemmas. 

2 Preliminaries 

Let (X, J) be a spectrally negative MAP. Let us use fx,i with x G M, i G E' to denote the law of 
(X, J) given {A'(O) = x, J(0) = i\. We often write Pi for Po,i. As much as possible we shall prefer 
to work with matrix notation. For a random variable Y and (random) time r, we shall understand 
Ea;[K; J(t)] as the matrix with (i, j)-th element "R^ ,i{Y\ (^T-^^j^) , where ^{a} denotes the indicator 
function of an event A. We also write fx[A-, J(r)] for a matrix with elements f^^i^A, J{t) = j). 
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Recall that X evolves as some Levy process Xi when J{t) = i. The Laplace exponent of Xi 
is denoted through ^i{a),a > 0: Ee""^**^*^ = e'^"'*^"-'*. In order to avoid technicalities we assume 
that none of Xi is a process with non-increasing paths. That is every Xi is a spectrally negative 
Levy process. This is a rather mild assumption, because a MAP can be time-changed so that such 
non-increasing stretches contribute to negative jumps; often the results concerning the original 
process can be recovered from this time-changed process. Essentially without loss of generality it 
is assumed that J is irreducible. Let Q be its iV x transition rate matrix. For all a > define 
an N X N matrix: 

F{a) = diag(V'i(a), . . . , ■07v(a)) + Qo G{a), 

where G{a)ij = Ke"^'^ and A o B ^ {aijbij) stands for entry-wise (Hadamard) matrix product. 
The matrix-valued function F{a) is referred to as the 'matrix exponent' of a MAP. It characterizes 
the law of {X, J) , and can be seen as a multi-dimensional analogue of the Laplace exponent of a 
Levy process. 

It is convenient to work with killed processes. We enlarge the state space of J to E'U {9}, where 
d is an additional absorbing state. Furthermore, we put A = oo whenever J = d. It is known that 
a MAP satisfies associated strong Markov property, that is, we can replace t with a stopping time 
T in the definition of a MAP. 

As a consequence of Perron- Frobenius theory F{a) has a real simple eigenvalue k{a), which is 
larger than the real part of any other eigenvalue. Using the standard facts from matrix analysis, 
see [7], one can show that fc(0) < 0; it is if and only if Q\ = (the case of no killing). In the 
case of no killing the real right derivative fc'(O) gives the asymptotic drift: 

fc'(O) = lim X{t)/t Pj-a.s. for all i e E. 

t^oc 

The first passage time of X over level ±a;, where a; > 0, is defined through 

= ini{t > : ±X(t) > x}. 

Observe that A(r+) = x, because of the absence of positive jumps. The strong Markov property 
of X implies that (t+, J(r+)), a; > is a MAP killed at A = sup{A(t) :t>0}. We will often use 
the transition rate matrix A of the Markov chain J(t+),x > 0: 

F[^(T+)]=e^^ (1) 

The matrix A is closely related to the matrix exponent F(a). In particular, the non-zero 
eigenvalues of —A coincide with the zeros of det(F(Q!)) in C^''^*' = {z E C : Re(z) > 0}, see [T5l 
Theorem 1]. In addition, A has a zero eigenvalue if and only if A = oo a.s., which is equivalent 
to Ql = (no killing) and fc'(O) > 0. For discussion concerning A and its identification through a 
certain matrix integral equation see (10 1 [51 [57 1 [5T | P71 [T^ . 

Remark 2.1. Let us point out some advantages of working with killed processes. Let eg be an 
independent exponential random variable of rate g > 0. Suppose we send J to the absorbing state 
d at t = Cq (it could have been killed before). By doing so we get a Markov chain with transition 
rate matrix Q — ql, which leads to a MAP with the matrix exponent F(a) — ql. Indeed, 

E[e"-^(*);t < eg, J(<)] = e-«*E[e"-^(*) ; J(t)] = e(^(")-«i)*. 

Similarly, 

E[e-'^-^;J{T+)] = P[r+ < e,, J(r+)] = e^''^ 

where A' corresponds to the matrix exponent F*(a) = F{a) — ql. It is then clear that —A'' reduces 
to the right inverse $(q) of the Laplace exponent in the case of a Levy process. Observe that a 
matrix of probabilities P[J(t+)] becomes a matrix of Laplace transforms E[e"'''^^ ; J(t+)] if one 
superimposes exponential killing of rate q > 0. Throughout this work we keep killing implicit, 
which greatly simplifies the presentation. 
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3 The main results 



Let us present our main results. We stress that the following statements are given in their concise 
form. That is, one can always superimpose exponential killing of rate g > to add the random time 
appearing in J(-) to the transform, see also comments following Theorem [TJ The main result of 
this paper concerns the two-sided upward problem (regarding Levy processes see [HI Thm. VIL8], 
P71 Thm. 8.1] and the references given in the latter book). 

Theorem 1. There exists a unique continuous function W : [0, oo) — > R^^-'^ such that W{x) is 
invertihle for all x > 0, 

P[t+ < Tj", J(t+)] = W{b)W{a + b)-^ for all a,b>0 with a + b>0, 

and 




for all a > Tj = max{Re(z) : z G C,det(_F(z)) — 0}. In addition, 

W{x) ^ e-^^L{x), (2) 

where L[x) is a matrix of expected occupation times at up to the first passage over x defined 
in 0). 

Theorem [T] is proven in Section [Sj Recall that it is enough to superimpose exponential killing 
of rate g > to obtain the formula for E[e~'?'^<' ;r+ < t^~, J(t+)]. We define L{x) and prove some 
properties of it in Section 21 Note that L{x) tends to L, the matrix of expected occupation times 
at 0, as a; — ?> oo. We prove in Lemma [TOl that L has finite entries and is invertible unless Ql = 
and A;'(0) = (the recurrent case). 

The scale matrix can be given in an explicit form in certain cases, such as in the case of a 
Markov- modulated Brownian motion (MMBM), where some variance parameters are allowed to be 
0, see [331 [HI [Hj. This result can be used to find the steady-state buffer content in a fluid model 
driven by Markov sources, see [2] and a survey [26]. Furthermore, a spectrally negative MAP with 
all the jumps of phase-type can be embedded into an MMBM. The scale matrix of this MMBM 
can be easily converted to the scale matrix of the original process. Many examples concerning scale 
functions of Levy processes can be found in [55] . 

Remark 3.1. In the context of spectrally negative Levy processes the representation ^ produces 
interesting links with known representations (see e.g. [H eq. (2.26)] and ^51 Thm. l(ii)]). To 
see it, recall that A — — $ where $ is the right-most zero of the Laplace exponent. In fact, $ 
depends on the killing rate q > which we keep implicit throughout this paper. First we consider 
the representation of W{x) in terms of the potential density u{-) of A as given in [36]. Namely, 
combining (i) and (ii) of j36, Thm. 1] we get for any q > the following 

W{x) = e*^[u(0) - u{x)u{-x)/u{0)]. 

It is not difficult to show that for g > the expression in the brackets is exactly L{x), see also [HI 
Eq. (V.18)]. Another representation of W{x) in terms of the potential measure of the descending 
ladder height process H{t) is given in [2 eq. (2.26)]. Comparing it to © we get 

L{x) = / e~*" / dtF{H{t) e dy) 
Jo Ja 

for at least q = 0. It would be interesting to provide a direct probabilistic proof of this identity. 
Some further identities involving L{x) can be found in [SJ Ch. V.3] 

Define now the reflection of X at (starting from an arbitrary x > 0): 

Y{t)^X{t)+R{t), 



4 



where R{t) = —(0 A JLit)) is a regulator at 0. Similarly define the reflection of the dual —X at 0: 
Y{t) = —X{t) + R{t), so that R{t) = (0 V X{t)). First passage times of the reflected processes are 
given by 

Ta = inf{t > : Y{t) > a}, fa = mi{t > : Y{t) > a}. 

In solving exit problems for the reflected processes the crucial is the second scale matrix: 

Z{a, x) = e"^ (^^ e-"2'W^(y)dyF(a)^ for a, x > 0. (3) 

Note that Z{a, x) is continuous in x with Z{a, 0) = I, and is analytic in a e C^'^^". In the case of a 
single background state and independent kilhng of rate g > we obtain Z'^{0, x) = 1+q W'^{y)dy, 
which is a common definition of the Z function corresponding to a spectrally negative Levy process, 
see, for example, [Ul p. 214]. The next theorem identifies, for a refiected process Y, the joint 
transform of the first passage time Ta and the value R{Ta) of the regulator at this time. 

Theorem 2. For all a>0 and a > it holds that Z{a,a) is invertible. Furthermore, 

E^[e-"^(^"); J(r,)] =Z(a,x)Z(a,a)-\ 

where x £ [0, a] . 

This theorem immediately results in the corollary, which solves downward two-sided exit prob- 
lem for X (see again [211 Thm. 8.1]. 

Corollary 3. For any a > 0,a > and x £ [0,a] it holds that 

E,[e'''"^^o^;T^ <T+,J{To)]^Z{a,x)^W{x)W{a)-'Z{a,a). 
Proof. Using the law of total probability and the strong Markov property of X write 

E,[e-"^(^»); J{Ta)] - P.[r+ < r^-, J(r+)] + E,[e"^(-o-); ^- < J(r-)]E[e-"«(^"); J(T,)]. 
Use the identities of Theorem [T] and Theorem [5] to complete the proof. □ 

Let us derive the identity for the first passage of X over a negative level. 
Corollary 4. Assume it is not true that Ql = and fc'(O) = 0. Then for all a;, a > 0, 

]Ex[e"^^^°"'; J(ro")] =Z{a,x) -W{x)L-'^{al + Ay^LFia). 

If a is a zero of det{F(a)) then it is a zero o/det(aI + A) and the expression on the right should 
be interpreted in a limiting sense. 

Proof. According to Theorem [1] for a > rj we have 

/>oo />oo 

Z{a,a)^e°"' e~"yW{y)dyF{a) = e'^'ywiy + a)dyF{a). 

J a Jo 

Recah that W{a) = e-^^Lia). Thus: 

W{a)-^Z{a,a)^ L{a)-^ / 6^-°'^-^^^ L{a + y)dyF{a). 

Jo 

Applying the dominated convergence theorem we derive 

lim W{ay'^Z{a,a) = / e^^^^-^^MyLFia) 
which proves the assertion of the theorem for a > rj. Analytic continuation completes the proof. □ 
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Assume that X(Q) — 0. Then R{t) = X{t) is the running supremum of X. Consider the process 
—Y{t) = X{t) — X{t) depicting excursions of X from its supremum. Suppose we kill the Markov 
chain {J{t^),x > 0} upon arrival of the first excursion (from the maximum) exceeding a certain 
height a > 0. Note that this excursion arrives at Ca = R{Ta) where we measure (local) time along 
the X coordinate. The strong Markov property of X shows that this killed Markov chain is again 
a Markov chain. Let us denote its transition rate matrix by Ajo.aj: 

P[a; < Ca, J(t+)] = e'^io.-i^ for ah x > 0. (4) 

Similarly, one can kill J(t^) upon arrival of the first excursion of height at least a, where a > 0. The 
corresponding transition probability matrix is denoted by A[o These two transition probability 
matrices are closely related to the scale matrix W and its one-sided derivatives. 

Theorem 5. For all a > the limits 

WUa) = \im{W{a + e) - W{a))/e, WLia) = \im{W{a) - W{a - e))/e 

exist. In addition, A[o^a] = W'^{a)W{a)^^ and A[Q_a) — W'_{a)W{a)~-'- . 

The above theorem shows that W{a), a > is differentiable if A[o.q] and A[o.q) coincide. For this 
to hold it is sufficient to require that every Xi is of unbounded variation. Theorem [5] is strongly 
related to fluctuation theory and excursion measure (compare with [?5J Lem. 2.3] and [23 Lem. 1]). 

Let us finally, identify, for the reflected process Y with Y{0) = x G [0, a], the joint transform of 
the first passage time Ta, the value R{Ta) of the regulator at this time, and the overshoot Y{Ta)—a. 
In theory of Levy processes this seminal result is due to [B] (see also e.g. [321 [33 [Ml [Ml [S3])- 

Theorem 6. tt holds for all a, > and x G [0, a] that 
Ey(0)=Je-'^'^^^»)-"(^(^»)-);J(f,)] 

= Zi[a^a — X) (a + 9)Z{a, a)]. 



4 Occupation densities and local times 

It has been noted above that occupation densities play a fundamental role in our construction of the 
scale matrix. In this section we first review the concept of occupation densities of a Levy process. 
Then we generalize it to the case of MAPs. Before we proceed let us define the first hitting time of 
a level x: 

T^"^> = inf{i > : X{t) = a;}. 
One can show following the steps of [HI Corollary 1.8] that t^^^ is a stopping time. 

Levy processes 

Throughout this subsection we assume that X is a Levy process with Levy measure v] we do not 
impose any restrictions on X yet (it may have positive jumps in particular). The Levy measure 
satisfies /^(l A x'^)v{Ax) < oo. If A is of bounded variation then necessarily /ig(l A |x|)z^(dx) < oo. 
In this case X equals in law to the process + X]o<s<t ^(*)' where A(t) is a Poisson point process 
with characteristic measure for some d G R which is known as the drift coefficient. Furthermore, 
a bounded variation process is a compound Poisson process (CPP) if and only if v has finite mass 
and d = 0. These and other facts can be found in the book [8]. 
In the following we assume that 

P(t^"^> < oo) > for all a: £ K. (5) 

For this to hold it is sufficient to require, see [Ml Thm. 1], that X is not a bounded variation 
process with d = 0, A is not monotone, and i/(0, oo) < oo. The Assumption ([S|) is sufficient, as 
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stated by ^5^1 Prop. 11.16, Thm. V.l], for the existence of the occupation density L{x,t) satisfying 
the occupation density formula 

f fiX{s))ds= f f{x)L{x,t)dx (6) 

for all measurable functions / > a.s. and any fixed t > 0, see [8l Eq. V.(2)]. When L{x,t) is seen 
as a function of t, we call it occupation time at the level x. Formally L(x, t) could be defined in the 
following way. 

Suppose that is regular for itself. Then for every a; e M 

L^ix^t) = Ye J ^{\x(o)-^\<^}'^^ 

converges uniformly on compact intervals of time in i^(P) as e J, 0, see [51 Prop. V.2]. This limit 
is denoted through L{x,t), which consequently is continuous in t a.s. 

If is irregular for itself then X is of bounded variation, see [TH Thm. 8] and recall that ([5]) is 
true. In this case we define: 

L{x,t) = \d\-^N{x,t), 

where N{x,t) = ^t'is e [0,t) : X{s) = x}, see also PU] . 

It can be shown that for each a; G M, the occupation time L{x^ ■) is an increasing 7^4-adapted 
process, which increases only \i X = x. Moreover, for every y and every stopping time T with 
X{T) — y on {T < oo}, the shifted process L{x, T + t) — L{x, T), t > is independent of under 
P(-|r < oo), and has the same law as L{x — y,t),t>0 under P. This property shows that if L(0, •) 
is continuous then it, in fact, coincides up to a constant factor with the local time of X{t) at 0, 
see Prop. V.4]. 

Finally, the following proposition will be important later on. 

Proposition 7. Assume that X is not a CPP. Then P(t{-^> < r") = /or any x > 0. 

Proof. It is known that the local extrema of X are all distinct, except in the CPP case, see [3 
rrop. VI.4]. So T^°> < has zero probability. Suppose next that for some a; > the event 
7-{-^} <; ]^as positive probability. Consider an independent CPP Y, which has deterministic 
jumps of size x. Note that the Levy process X + Y can achieve its infimum without immediately 
passing it with positive probability (there is exactly one jump of Y in the interval [0, r^^^^]; note 
that T^~^^ > a.s., because the paths of X are cadlag). Hence it is a CPP, which further implies 
that X is a CPP too, which is not the case. □ 



MAPS 

Let {X, J) be a MAP satisfying the assumptions of Section [2l The structure of MAP allows for 
immediate generalization of the concept of occupation densities. It is not difficult to show that the 
process X observed at the times when J = i is a Levy process. It can be seen as an independent 
sum of Xi and a CPP. The latter process incorporates the increments of X corresponding to the 
time intervals when J ^ i. These increments need not to be negative. Importantly, this Levy 
process satisfies the assumption ([5]); one can check the conditions following ([5]). 

Let us define L{x,j,t)^ the occupation density of (X, J) at {x,j) up to time t. If is irregular 
for itself we put 

Lix,j,t) = e [0,0 : X{s)=x,Jis)^j}, 

where dj > is the drift coefficient of Xj \ otherwise L{x,j,t) is the limit in L'^{F) of 

1 ft 

L''ix,j,t) = — J l{\X{s)~x\<e,Jis)=j}<is 

as e J, 0. Moreover, the occupation density formula becomes 

/ /(X(,s))lp(,)^,jds = / f{x)L{x,j,t)dx. 
Jo Jr 
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Observe that L{x,j, t) is an increasing J^t-adapted process, which increases only \i X = J = j. 
The strong Markov property of X imphes the following result. 

Proposition 8. For every y, i and every stopping time T with X{T) = y on { J(T) = i}, the shifted 
process L{x, j,T + t) — L{x, j,T),t > is independent of J-t under ¥{-\J(T) = i), and has the same 
law as L{x — y,j,t),t > under P^. 

This proposition immediately results in the following identity for x ^ 0: 

Ei(a;,j,oo) =P[J(rW)]EL(0,j,oo). (7) 

This identity would be true for all x if we replaced the first hitting time with the first entrance 
time. Let L he a N x N matrix with (i,j)-th element equal to E,iL{0, j, oo). Observe that L has 
strictly positive entries. 

Theorem 9. For all a > 0, such that k{a) < 0, it holds that 

[ e"^P[J(T't=">)]dxi = -F{a) 
Proof. Firstly, by the monotone convergence theorem we get 

pt /"OO 

E^lim y e"^(")ej(,)ds = y e^'^"'>'ds = -F{a)-\ 

where we used the fact that the real parts of the eigenvalues of F{a) are all negative. Using the 
occupation density formula we obtain 

lim / e"^(")l{,7(,)=j}ds = lim / e""" L{x, j,t)dx ^ f e°''L{x,j,oo)dx. 

Identity (O completes the proof. □ 

Remark 4.1. If there is an a satisfying the conditions of TheoremlHlthen both L and j'^ e"^P[J(T^^^)]da; 
must have finite entries. Furthermore, L is then invertible. This is the case if Q is transient: Ql ^ 0, 
because then fc(0) < 0. 

Let us introduce another matrix L{x),x > 0, which will play an important role in the study of 
the scale matrix. Let 

U,{x)=E,L{0,j,T+) 

for X > 0. That is, L{x) is the expected occupation time at up to the first passage time over x. 
Clearly, the elements of L{x) are non-negative, non-decreasing functions with Imix^oo L{x) ^ L. 
In addition, we define L{0) = lima;4,o L{x). But r + J, 0J.S. cLS X ], 0. Hence 

, , . ^ ^ , , \ 1/di if i — j and Xi is of bounded variation, , . 

L.,(0)=E.L(0,,,0-,)^|/ otherwise. 

Hence L{x) is the expected occupation time at up to and including first passage over a; > 0. In 
view of Proposition |5] the matrix L{x)^ x > can be expressed as 

L{x)^L-P[J{T+)nJ{T^-^i)]L, (9) 

given that L has finite entries. 

Let us next present a technical lemma. 

Lemma 10. For any u > it holds that e~'^^ L{x)dx has finite entries. Moreover, matrix L 
has finite entries unless Ql = and fc'(O) — 0. 

Proof. See Appendix. □ 

The condition Ql = and fc'(O) = excludes recurrent processes. The above lemma implies 
that the entries of L{x) are finite. Furthermore, they are continuous functions of a; > 0. To see 
this use the definition of L{x) and a.s. continuity of t+ at a fixed a; > 0. 
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5 Two-sided exit and the scale matrix 



One of the key ingredients in the construction of a scale matrix is given by the following lemma. 
Lemma 11. For any a,b>0 with a + b> the events {r+ < t^^} and {r+ < t^^^^} coincide a.s. 

Proof. If T+ < Tf^ then r+ < t^''^\ because t^^ < t^^''^ a.s., which follows immediately from 
Proposition [71 It is left to show that < r+ implies t^~''^ '''a ■ If '''b ^ '''a then t^~''^ < r+, 
because of the absence of positive jumps (the level —b should be hit on the way to the level a); 
the equality arises if X is killed before reaching t^~''\ If Tj^ = r+ then t+ = oo and hence 
r{-''} <T+. □ 

The above lemma allows us to study P[r+ < Tf-^>; J(t+)] instead of P[r+ < t~; J(t+)]. The 
advantage of using the stopping time t^~''^ instead of Tj^ is that the value of X is known at the 
first time, but not at the second. Pick arbitrary a,b > such that a + b > and consider the 
following equations, which are an immediate consequence of the strong Markov property: 

P[J(r+)] = P[r+ < r{-^}; J(r+)] +P[r{-^} < r+; J(r{-^})]P[J(r++J], 
P[J(r{-''})] =P[t^-''> <t+; J(r{-''})]+P[T+ < t{-^>; J(r+)]P[J(r{-"-''})]. 

Right-multiplying the second equation by P[^^(T^f,)] = e'^*^°+'') and subtracting the first one gives: 

^[^a < rf"^>; J(r+)](P[J(r{-"-''>)]e^('^+'') - I) 
= P[J(T'f-^>)]e'^(°+^) -e^". 

Hence 

P[r+ < r{-^>; Jir+)]W{a + b) = W{b), (10) 
where we define W(x) for all a; > through 

W{x) = (e-^" - P[J(t^-">)]) i, (11) 

and L is the matrix of expected occupation times at defined in Section 21 Note that pH)) holds 
true if L is replaced by an arbitrary constant matrix. The importance of our particular choice will 
be made clear in a moment. We note that ([TTl) is well defined whenever L has finite entries, which 
is the case unless there is no killing Ql — and the process X oscillates: fc'(O) = 0, see Lemma [TOl 
The later delicate case will be treated using a limiting argument. It can be shown that in this case 
the matrix in the brackets in (|lip is singular and the entries of L are infinite. 

The following lemma identifies the transform of W{x) in the case when killing is present. Recall 
also the definition of rj as given in Theorem [1] 

Lemma 12. If Ql 7^ then for all a > rj it holds that: 

e-°"'W{x)dx = F{a)-\ 

Jo 

Proof. Using (fTT|) we write 

fOO POO POO 

/ e-""W^(2;)dx = / e(-^-"^)"dxi - / e-""P[J(T^-">)]da;L. 
Jo Jo Jo 

Recall that the set of eigenvalues of —A coincides with the set of zeros of det(F(a)) in C^'^^°. 
Hence the first integral on the right converges and is equal to {al + A)^^ for a > rj. In addition. 
Theorem [9l gives 



POO POO 

F{a)-^ = e"-^P[J(T't^>)]da;J: + / e-°^P[J(r{-^>)]dxL 
Jo Jo 



(12) 
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for a > with k(a) < 0. Recall that fc(0) < when Ql ^ 0. The continuity of k{a) implies that 
there exists e > such that k{a) < for all a & [0, e). Equation (fT2)) can be rewritten as 

e~"^P[J(T^-^>)]dxi = F{a)-^ - {al + A)-^L (13) 

for a e [0,e), because the real parts of all the eigenvalues of {al + A) are negative. The proof 
is complete as soon as we show that the latter identity can be continued to a > 77. To see this, 
multiply both sides by F{a) from the right and by (al + A) from the left. Then both sides are 
analytic for a G cRc>o^ hence the equality holds for these a. Finally, the matrices F{a) and 
(al + A) are invertible for a > r/, so the above multiplication can be reversed. □ 

Let us proceed to the general case. Observe that pT|) can be rewritten using ([T]) and © as 

W{x) = e-^^L{x). (14) 

This equation can be used as the definition of the scale matrix W{x) in all the cases including the 
delicate case when X oscillates. Recall that L{x) is continuous in x > and hence so is W{x). 
Furthermore, W{0) — L{0) which is given in Let us finish the proof of our main result. 

Proof of Theorem [7J It is left to show that the displays in the statement hold for the case of no 
killing, and that W{x) is invertible for all x > 0. 

The first part is based on a continuity argument. Superimpose independent exponential killing 
of rate g > 0, and denote the corresponding quantities through F'>{a), A', L'^{x),W'^{x). The first 
three objects converge to F{a), A, L{x) respectively as q J, and hence also W'^{x) W{x). Take 
the limits in (fTU|) and use the dominated convergence theorem to show that (|10p also holds in the 
case of no killing. Taking limits to obtain the transform is not that straightforward, because the 
entries of W{x) are not necessarily non-negative (except when X is a Levy processes where the 
extended continuity theorem for Laplace transforms could be applied). 

First observe that L'^{x) < L{x), where the inequality is entry- wise. Moreover, according to 
Lemma [U there exists A > and qo > such that the entries of the matrix e~'^^e~^''^ are 
bounded in absolute value for all x > and q S [0,qo). Lemma [TU] allows to apply the dominated 
convergence theorem to establish the transform of the scale matrix for a > A and q = 0. It is only 
left to show that this identity can be continued to all a > rj. Note that for a > rj the entries of 
^-ax^-Ax g^j.g bounded in absolute value for all x > 0; one can use the Jordan decomposition of 
A. But then Lemma [TUl implies that \e~°'^Wij{x)\dx < 00 for any So the entries of the 
transform e~'^^W{x)dx are analytic functions in the domain Re(a) > rj, see 011 Ch. II]. Hence 
the transform can be continued as stated above. 

Let us show that W{x) is invertible for all x > 0. It is enough to establish invertibility of L{x). 
For this observe that the following relation is true for y > according to Proposition [51 

L{x + y) = L{x) + P[J(r+)]P[T{-"> < r+, J{t^-^'^)]L{x + y). 

Notice that P,(r^-^> < r+) < 1, hence the matrix I-P[J(r+)]P[T{-^> < r+, J(t{-^>)] is invertible 
for any x, y > 0, because it is strictly diagonally dominant, see [7]. Thus if for any x > there is 
a vector v, such that L{x)v — then L{y)v = for all y > 0. But then F{a)^^v = for a > ry, 
which is a contradiction. □ 

Remark 5.1. In the standard construction for Levy processes described in e.g. [5] and |27| one starts 
from considering no killing and process X drifting to -l-oo. Then Vt^(x) is taken proportional to 
P(X > — x). On the contrary our construction works in all scenarios except one delicate case, when 
the process is recurrent. If in our set-up we assume additionally that q = and X drifts to -l-oo then 
the expression in the brackets in dTTI) simplifies to 1— P(t^^^^ < cxo) — P(r'f^^^ — 00) = P(^ > — x), 
which is known to coincide with V{2L ^ — x). 
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6 Two-sided reflection 



In this section we consider two-sided reflection of X with respect to an interval [— a, 0], where 
a > 0. The main result of this section, Theorem 1131 is a cornerstone in solving exit problems for 
processes Y and Y . Assume that X{Q) = x G [—a, 0] and define the solution of Skorohod problem 
H{t) e ha,0] by 

H{t) ^X{t) + R4t)-R*{t), 

where i?* and R* are the regulators at the lower barrier —a and at the upper barrier respectively. 
That is, i?* and R* are non-decreasing processes with R^,{0) — R*{0) — 0, such that their points 
of increase are contained in {t > : H{t) = —a} and {i > : H{t) — 0} respectively. It is known 
that such a triplet {H,Rt,,R*) exists and is unique, see [25j. 

Observe that the process R* is continuous, because X has no positive jumps. It can be seen as 
the local time of at 0. Let pr be its inverse: 

Pr = inf{t > : R*{t) > r} for r > 0. 

In other words, pr is the first passage time of R* over r. Note also that R*{pr) — r and H{pr) — 0. 
The strong Markov property of X shows that {R^.{pr), J{pr)),r > is a MAP itself. In fact, it is 
a Markov-modulated compound Poisson process, because it has no jumps in a fixed interval with 
positive probability. We denote its matrix exponent through F*{a), that is, for a > and r > it 
holds that 

The aim of this section is to identify the law of (i?, (pr), J{Pr)) for any A'(O) £ [— a,0]. This law is 
characterized in the following theorem. 

Theorem 13. For all a > and x £ [— a,0] it holds that Z{a,a) is invertible and 

F*{a) ^W{a)F{a)Z{a,a)-'^ - al, (15) 
E^[e-°'"-'^P"^;J{pa)] = Z{a,a + x)Z{a,a)-\ (16) 

Proof. It is enough to prove the theorem for a killed process; one can use a continuity argument as 
in the proof of Theorem [T] to extend the statement to the case of no killing. Hence we can assume 
that Ql ^ 0. From the definition of the two-sided refiection we have = X{pr) + R^,{pr) — r. So 
{X{pr), J{pr)) is a MAP such that its every underlying Levy process is of bounded variation with 
drift equal to 1. Hence its occupation density, see Section SI is defined through 

L*{y,j, oo) = #{r > : = y, J{pr) = j}. 

The occupation density formula states that 

e"''('''-^l{,/(p.)=,}dr = y^e"^L*(2/,j,oo)dy. 

Taking expectations on both sides we obtain 

E,[e"^('''-); J(p,)] = / e"^E,L*(y,^)dy. 
Js. 

But the left hand side can be rewritten as 

poo 
"'0 

In the rest of the proof we will show that for small enough a > it holds that 

e"^E^L*(y,oo)dy = -Z{a,a + x)F{a)-^W{a)-\ (17) 



oo 
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In particular, the integral on the left converges, which implies that e^^e^ (")»'cir converges, and 

E^[e~''^'^P'>'>; J{po)]{F*{a) + al)-^ = Z{a, a + x)F{a)'^W{ay'^ . (18) 

Note that po — a.s. when x = which leads to ([T5|) . Plugging ([T5]) into we obtain 
Finally, analyticity arguments allow to continue these identities to all a > 0. 

We are only left to show that pT|) holds for small a > 0. Observe that L*{y,j,oo) is equal to 
the number of time points t > 0, such that X{t) — y, J(t) = j and i is a point of increase of R* . 
For 6 < let 

C, = P(J(rW))P(J(r+)) 

be the probability of hitting the level b and after that passing through the level a + b. One can 
show that 

oo 

E,L*(y, oo) - (1{,>o}P.(J(t+)) + l{^<o}C^-a~x) ^^(^-a)*- (19) 

i=0 

Indeed, if y > then the first point counted by L*{y, oo) is given by , otherwise X has to hit 
level y — a to insure that at the next passage over y the process H is at its upper boundary (so 
that we get an increase point of i?*). Every next point is obtained in a similar fashion: X needs to 
descend to the level y — a and then to pass through y. Here we also use the strong Markov property 
oiX. 

For a killed process we have X]i^o(^-a)' = (I ^ C-a)^^ ■ Take the transforms of the both sides 
of (HH) to obtain 

e"yE^L*{y,oo)dy ^ (^J^ e^^e^^^'-^'My + J e"^P( J(T<2^-''-^>))dye^''^ (I - C_a)-\ 

The first term inside the large brackets is —(A + aT)^^e~-^^ for small enough a > 0. The second 
term is e"(''+^) e-"yp{J{T^-y'i))dye^'' . It is not difficuh to see that for smaU a > it holds 
that 

/•oo rx 

e-"^P(J(r^^^>))dy = -F{ay^L-^ + (A + aI)-^e-^^+°'^'>'' + / e-°'yW{y)dyL-^; 

Jo 

for this integrate (fTT|) over (0,x) and use (fT3|) . Combine the last two displays to obtain 

^ e"^E,L*(y, oo)dy = e"('^+^) (^^"''" e-"«W^(y)dy - F{a)-'^ L-^e^''{l - C^a)-'- 

In addition, the construction ([TT|) shows that I — C_a = VF(a)-L^^e^'', and hence the term following 
large brackets reduces to W{a)^^. So we finally get ([TT)) . □ 

7 Further exit problems 

The two-sided reflection, as considered in the previous section, is intimately related to the reflection 
at a single barrier. In fact. Theorem [T3] allows for a rather simple derivation of the exit identities 
given in Theorem [5] and Theorem [S) 

Proof of Theorem\^ It is enough to observe that {H{t) + a,R^,{t)) up to time po coincides with 
{Y{t),R{t)) up to Ta given H{0) + a = r(0). The second identity of Theorem [H yields the 
result. □ 

Proof of Theorem [31 Observe that for any < e < (5 it holds that 

P[e < Ca, J(t+)] < P[r+ < T-, J(T+)] < P[e < (a+S, J(T+)], 

where Ca is the (local) time when the first excursion of height exceeding a arrives. Subtract I, 
divide by e and let e | to obtain in view of (H)) the bounds 

A[o,a] < \ym{W{a)W{a + e)-^ - l)/e < A[o,a+s]- 
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Deduce from probabilistic interpretation that e — )■ e [""i^ for every x as S ^0. This imphes 
the convergence A[o_a+5] ~^ ^[a.a] which completes the proof of the first part of the theorem. 

The proof of the second part follows the same steps. In this case we start by establishing the 
bounds: 

□ 

Proof of Theorem\^ Assume X{Q) = and consider {{Rt,{pr), J{pr)), r >0},a. Markov-modulated 
compound Poisson process with matrix exponent F*{a). Let 

C = inf{r > : R^Pr) > 0} 

be the epoch of the first jump of R^:{pr)- Observe that R*{t) coincides with X{t) up to the time 
when i?, becomes positive (the lower barrier is hit). Hence C, is the (local) time at which the first 
excursion from the maximum of height exceeding a arrives. Use Lemma [12] in Appendix to note 
that A[o,a] = F*{oo) and 

g^j^_eC-afl.(Pc); = I _ (A[o^,] - ei)-HF*{a) - ei) (20) 

for all 6* > and a > 0. 

Suppose now that X{Q) = —x, where x G [0,a], and let 

qq = mi{t >0:R4t)> 0} 

be the first increase point of R^,. Observe that 

Hence we only need to calculate the latter. Recall that p^ is the first time the process H{t) hits 
the upper barrier after it has hit the lower barrier. Using the strong Markov property of X we can 
write: 

E_,[e-«^-"«*(''<); J(pc)] = E^.ie-^^*^^")-"^*^^''); J(eo)]E-a[e-"^*(''«^ J(po)]. 

Alternatively, this expectation can be computed by considering the event {tq^ < "'"oT} ^^^^ its 
complement: 

E_,[e-^«-"«-(^<); J(PC)] -P-.[ro+ < , J{r+)]Eo[e-<''^-"'''^''^^ ■ J{p^)] 

+E_,[e-"^*(''°);T- <T+,J(po)]. 

The last term reduces to E^^rie""^*^''"); J(po)] - ^-x{t^ < t-,J{t^)). Combine the last two 
displays and use equation ((20| , Theorem [1] and Theorem [13] to obtain 

E_,[e-«^'*(e°)-"«*(e"); J(go)]^(a, 0)Z(a, a)-i 

= W{a-x)W{a)'^[l~{K[o,a\ - ei)-^ {W {a)F{a)Z{a,a)-^ - {a + 6)1)] 
+ Z{a,a~x)Z{a,a)-^ ~ W {a ~ x)W {a)'^ . 

Note that Z{a^ 0) = I and A[o ~ —W'^{a)W {a)^^ according to Theorem[S]to finish the proof. □ 



Appendix 

Proof of Lemma \1(A At the beginning we prove the second claim of this theorem. Recall that by 
Remark 14.11 the matrix L has finite entries if Q is transient. Consider now the case case of no 
killing with fc'(O) ^ 0. Then EiL(0,j,eq) = e-'J*EiL(0, j, t)dt < oo. This further implies that 
EiL(0,j, t) < oo for any deterministic t. Let T{j,t) = inf{s > t : X{s) = 0, J(s) = j}. Note that 
Fj{T{j,t) < oo) < 1 because by condition k'{0) ^ the process X drifts to +00 or to —00 (see [H 
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Prop. XI. 2. 14]). It is enough to show now that Ej_L(0, j', oo) < oo. But the regenerative structure 
of L imphes that 

E,L(0,j,oo) < ^P,(t(j, < oo)"E,L(0,j,i), (21) 

n>0 

which is finite when fc'(O) ^ 0. 

The proof of the first claim follows similar steps. Let Cu be an exponential random variable of 
rate u independent of everything else. It is enough to show that EL(e„) < oo. Note that Ei(e„) 
is the expected occupation time at up to hitting the random level Cu- Hence the corresponding 
entries of Ei(e„) arc bounded from above by the entries of L. So we only need to consider the 
case of no killing with fc'(O) = 0. In this case the counterpart of inequality (PT|) is 

E,L(0,j,r+) < ^P,(r(j- < r+)"E,L(0, j,i)- 

n>0 

The proof is completed by observing that Pj(T(j, t) < t+ ) < 1 because X oscillates. □ 

Lemma 14. There exists a constant Cn such that the elements of the matrix e~'^*e~'^* are bounded 
in absolute value by C„ for any t > 0, n x n transition rate matrix Q, and A > — X^iLi 'in- 
Proof Let P{t) = e<3*, so e-^*e-^* = e~^*P{t)-\ Observe that 

71 

det(P(i)) = J|e^'* = e'^('3)*, 

4=1 

where Xi are the eigenvalues of Q, and tr{Q) is the trace of Q. Moreover, the entries of transition 
probability matrix P{t) are bounded by 1, hence the cofactors of P{t) are bounded by C„, a 
constant which only depends on n. According to Cramer's rule we get a bound e~'^^'*'*'^'^'5))*(7^ for 
every element of the matrix e~^*e~'5*_ The claim now follows immediately. □ 

Lemma 15. Let (X, J) be a Markov-modulated compound Poisson process without negative jumps, 
such that E[e-"-^(*); J(t)] = e^(")*. Let also T = {t > : X{t) ^ 0} be the epoch of the first jump 
of X . Then J(t) killed at t = T is a Markov chain with transition rate matrix F(oo). Moreover, 
for q > and a > it holds that 

E[e-«^-"^(^); J(T)] = I - (^^(oo) - ql)-^iF{a) - ql). 

Proof. Observe that E[e^"'^*^'^«^ ; J(eg)] = g Jq°° e^^'^^^^'^^Mt, which converges and is equal to 
—q{F{a) — ql)^^ for all q > and a > 0. Furthermore, 

lim E[e-"^(^'); J{eg)] = P[X(e,) - 0, J(e,)] - P[e, < T, J(e,)] = -q(A - ql)-\ 

where A is the transition rate matrix of J killed at the first jump of X. This shows that F(oo) = A. 
Using the strong Markov property and memoryless property of Cq we write 

IE[e-"^K); J(e^)] ^ p[e^ < T, J(e,)] + E[e-"^(^); e, > T, J(r)]E[e-"^('='); J{eg)]. 

Use the above observations to complete the proof for q > 0. Let q X to obtain the result for 
q = 0. □ 
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